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OBJE CTIVES 

The main objective of this study is to compare the effects of two versions 
of a Minicourse entitled Higher Cognitive Questioning , Minicourses are a 
series of self-instructional microteaching packages developed by the Far West 
Laboratory for Educational Research and Development for the purpose of in- 
service teacher education. One version of the Minicourse involved use of 
videotape modeling procedures and videotape feedback after each microteach- 
ing session. The contrasting version involved use of written modeling pro- 
cedures and audiotape feedback after each microteach session. 



A second objective is to compare the Minicourse which used videotape modeling 
and videotape feedback with an entirely different course. The other course 
used a handbook with written materials based on Gallagher rather than Bloom 
and employed small group discussions among interns rather than microteaching. 



BACKGROUND 

A previous research study conducted at the Far West Laboratory indicated 
that videotranscript (written) modeling of questioning skills, a relatively 
low-cost item, was as effective as videotape modeling in changing the teach- 
ing performance of intermediate-grade inservice teachers. Videotranscripts 
consisted of typed versions of the videotape? used in the comparison treat- 
ment. Both treatments were similar in that they used videotape feedback 
during the microteaching phase of the Minicourse. In the present study, 
the investigators were interested in the effectiveness of an even less ex- 
pensive, simpler treatment: videotranscript modeling and audiotape feed- 
back. There is reason to believe that this treatment might be effective 
since an earlier study had demonstrated the effectiveness of audiotape 
feedback when used with another Minicourse ( Individualizing Instruction in 
Mathematics). However, the Far West Laboratory studies were conducted 
with inservice teachers. The present study involved a group of preservice 
teacher interns. It did not include a control group which did not receive 
the Minicourse in any form. However, it has generally been found in simi- 
lar studies that control groups do not make "spontaneous" gains over the 
one-month period of the usual Minicourse. Thus, a control group would have 
been helpful, but not essential, for interpreting the results of the experi- 
ment. , 

The handbook/discussions group may be regarded as a control group in one 
sense. They did not take the Minicourse nor did they employ microteaching. 
However, they did receive an experimental treatment rather than a "no treat- 
ment" condition. 
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METHOD 

The subjects were University of Oregon interns who were assigned to teach 
in grades 3-6 in five Oregon communities. Forty-eight subjects were randomly 
assigned to three groups. Group A (N«16) took the Minicourse version which 
included videotape modeling and videotape feedback. Group B (N«16) took 
the Minicourse version which included videotranscript modeling and audiotape 
feedback. Group C (N«16) took the course which used Gallagher's question 
categories and saall group discussions among interns. The Minicourse involved 
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about fifteen hours of instruction, including eight microteach sessions, over 
a period of about seven weeks. The handbook/discussion course involved an 
equivalent amount of time* 

DATA COLLECTION 

Immediate pre- and post-training audiotapes were made of twenty-minute class 
discussions conducted by each teacher* The tapes were scored by trained 
raters for incidence of questioning skills taught in the Minicourse. Raters 
were trained to at least .80 interrater reliability before they began actual 
coding of the tapes. Raters also computed length and frequency of responses 
to teacher questions. Groups A and C were given an additional pre- and post- 
training test which consisted of writing ten questions based on pictures. 

RESULTS 

Previous research indicates that the average percentage of higher cognitive 
questions asked by teachers without specific training in this classroom skill 
is about 33 percent. This finding was also borne out in the present study. 
The average pre- test percentage of higher cognitive questions was 37 percent 
for Group A and 34 percent for Group B. Approximately nine weeks later, in 
the post-test, Group A asked an average of 60 percent higher cognitive ques- 
tions t and Group B asked an average of 55 percent. Group C moved from an 
average of 35 percent in the pre-test to an average of AA percent in the post- 
test. 

In the pre-test the mean length of answers for students taught by Group A 
teachers was 10 words. The average length increased to 13 words, on the 
post-test, A comparable gain was recorded for Group B, The average length 
of their responses increased from an average of 12 words to an average of 
16 words* Group C decreased from an average of 11 words to an average of 
10 words. 
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The paper consists of three parts: 

A. Videotape Versus Written Instruction and Videotape Versus Audiotape 
Feedback: A Report to the Far West Laboratory by Keith A. Acheson 
and Paul E, Tucker. 

B. Audiotape and Videotape Feedback: Review of Related Literature, oy 
Paul E. Tucker. 

C. Videotape Minicourse Versus Questioning Strategies Course Using Read- 
ing and Discussion: A Report to the Far West Laboratory by Keith A 
Acheson and Calvin J. Zigler. 



PART A 



VIDEOTAPE VERSUS WRITTEN INSTRUCTION 
and 

VIDEOTAPE VERSUS AUDIOTAPE FEEDBACK 
IN A MINICOURSE ON HIGHER COGNITIVE QUESTIONING 



Keith A. Acheson 
Paul E. Tucker 



University of Oregon 
1971 



MINICOURSE REPORT 

This paper reports the results of studies conducted at the University 
of Oregon during Winter quarter of 1971, using Minicourse Nine, Thought 
Questions in the Intermediate Grades, developed by the Far West Educational 
Laboratory for Research and Development. Subjects in the study were interns 
from the University of Oregon who were teaching in Grades 3-6 in five 
Oregon communities. Thirty- two subjects were randomly assigned to one of 
two groups. Group A, n=16, took Minicourse Nine using videotape demonstration 
and instruction with videotaped microteaching practice. Group B, n=16, took 
Minicourse Nine using videoscript (written) demonstration and instruction with 
microteaching using audiotape recordings rather than videotape for feedback 
purposes during the practice phase of the course activities* Previous 
research conducted by the Far West Laboratory had indicated that the video- 
script instruction and demonstration had been as effective as videotape 
viewing in learning to ask higher cognitive questions in the intermediate 
grades. However, the experiments had used videotape feedback during the 
microteaching practice portions of the program. Hence, the major variable 
that was being manipulated in the present study was the substitution of 
audiotape microteaching feedback in place of videotape microteaching feedback. 

A survey of the literature on audiotape and videotape feedback indicated 
that audiotape feedback could well be used as effectively as videotape in 
developing a skill (such as asking higher cognitive questions) which focuses 
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primarily on verbal behavior as opposed to nonverbal behaviors which would 
be evident only in videotape records. In the case of Minicourse Nine, the 
verbal behaviors under consideration are those derived from Bloom's Taxonomy, 
the Cognitive Domain, namely teachers' questions which call tor Knowledge, 
Comprehension, Analysis, Synthesis, and Evaluation. These questions can be 
divided into two major categories - with Knowledge being thought of as 
"lower cognitive/ 1 and all the others put together labeled as "higher 
cognitive 11 questions. One of the stated performance objectives of Minicourse 
Nine Is that at least two-thirds of the participants taking the course should 
increase by at least sixty percent their use of higher cognitive questions in 
a post-test as compared with the baseline determined in a pre-test. Twelve 
previous studies had shown that the average percentage of higher cognitive 
questions asked by teachers without specific training in this classroom skill 
is about thirty- three percent. In the present study, these findings were 
borne out. The average percentages for higher cognitive questions in the 
pre-test for groups A and B were thirty-seven percent and thirty-four percent 
respectively. Furthermore, an analysis of variance showed that there was no 
significant difference between the two groups on their use of higher cognitive 
questions in the pre-test. Group A (videotape instruction and feedback) and 
Group B (written instruction and audiotape feedback) for all practical 
purposes were equivalent in their use of higher cognitive questions at the 
beginning of the experiment. 

At the time of the post-test, approximately nine weeks later, Group A 
had an average percentage of 60 percent higher cognitive questions and 
Group B had an average percentage of 55 percent higher cognitive questions, 
or a mean gain of 62 percent in both groups* Nine out of sixteen interns 
in Group A, or 56 percent, had a gain of at least 60 percent. Nine out of 
sixteen interns in Group B, or 56 percent, had a gain of at least 60 percent 
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in their use of higher cognitive questions from pre- to post-test. It would 
appear that the criterion stated above had not quite been reached; i.e. at 
least two-thirds of the participants gaining 60 percent. However, two people 
in Group A had initial percentages of 67 and 86, thus it would have been impos- 
sible for them to gain 60 percent since that would have resulted in asking more 
than 100 percent higher cognitive questions. Likewise, in Group B two people 
had initial percentages of 75 and 87 percent respectively. Hence, if we eliminate 
those two members of each group for whom the criterion was impossible, we may say 
that both groups approximated the performance objective of the course in terms 
of percentage of higher cognitive questions asked. (Table 1) 

The other performance objective of the course is phrased in terms of student 
responses to teachers 1 higher cognitive questions - specifically the objective 
is that in post-test recordings two-thirds or more of the discussions have an 
average student response length of 12 words or more to higher cognitive 
questions asked bv the teacher. Groups A and B in the present study began 
with average student response lengths in the pre-test of 10 and 12 words 
respectively. In the post-test the average student response length to higher 
cognitive questions for Group A was 13 words and for Group B it was 16 words. 
Thus on the second performance objective both groups achieved the criterion of 
12 words on the average. In terms of classrooms, seven of the classes in 
Group A reached 12 words or more for student responses to teacher higher 
cognitive questions and 12 of the classes in Group B recorded an average of 
12 words or more. On this basis the video group does not reach criterion but 
the audio group exceeds criterion with 75 percent of the classrooms. Again 
looking at averages for both* groups, the mean length of student response 
increased by 30 and 33 percent respectively. Table 2 in the Appendix presents 
this complete information. 

O 
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The present 9tudy was nlso concerned with whether there were any 
significant differences between the two groups on Che post-test in reject to 
total percentages of higher cognitive questions and also in respect to the five 
individual categories of questions (Knowledge, Comprehension, Analysis, 
Synthesis, and Evaluation) used in the study. Analysis of covariance indicated 
thai there were not significant differences between the two groups in any of 
the above comparisons* Tables ^ through in the Appendix display the data 
and results of calculation for the above statement* Therefore, in summary 
we may say that on both performance objectives and on all criteria and tests 
made in the study, Group B, or the audio microteaching group, was as successful 
or more successful than Group A, the videotape group. 

Statistical analyses were made of additional information collected 
during the study. Analysis of covariance was applied to the data on length 
of student responses discussed above. There were no significant differences 
between the two groups in their post- tests despite the apparent advantage 
of the audio group obtained by counting the number of classes which achieved 
the criterion. Table JLO presents the data and the calculation for this result. 

The number of student responses to teacher higher cognitive questions is 
also a statistic of interest. To get a comparison between the two groups, 
the following procedure was followed. First, the number of student responses 
to teacher questions was calculated for each discussion. Then the number of 
responses to higher order questions was calculated. From this information, 
the percent of higher order question responses for each discussion was calculated. 
The resulting percentages were then compared between the two groups using 
analysis of covariance and the difference was found to be significant a't the 
•05 level, favoring Group A, the video group. Thus the percent of responses 
to higher cognitive questions was significantly greater in the video group than 
it was in the audio group using adjusted post-test means. Another way of 



looking at this data is to take the total number of responses in the pre-test 
and post-test for both groups. Such comparisons contain an element of risk 
since the length of discussions was not held exactly constant. Group A had 
2715 total responses in the nre-test of which 890 wereVto higher cognitive 
questions, or 33 percent. On the post-test they had 173o total responses of 
which 985 were to higher cognitive questions, or 57 percent. Group B on the 
pre-test had 1615 total responses, 313 to higher cognitive questions, or 19 
percent. On the post-test 9 Group B had 1877 total responses, 667 to higher 
cognitive questions, or 36 percent. While Group A had fewer total responses 
In the post-test than in the nre-tc>st, it increased the number of responses to 
higher order cognitive questions. Group B increased both the total number of 
responses and the number of responses which were higher cognitive questions. 

Any conclusions in regard to these data are speculative but it appears 
possible that th? teachers in Group' A somehow had their students more involved 
In the higher cognitive questions than did those in Group B when we recall that 
there was no significant difference in the mean length of student responses to 
teachers 1 higher cognitive questions. The raw data are not such that these 
differences can be investigated. However, further research should be able to 
parcel out the unique effects of videotape feedback as opposed to audiotape 
feedback as it applies to a teacher's ability to elicit student responses to 
higher cognitive questions. One hypothesis might be that teachers exposed to 
videotape feedback will be more sensitive to the need to call on several 
students when a higher cognitive question has been asked since they have 
watched students who did not respond to questions; whereas, the audiotape 
group will have heard only students who did respond. 



-6- 



One difference between the present study and the previous main field 
test of Minicourse Nine conducted by the Far West Laboratory was that 
teachers in the present study were free to choose their own topics for 
discussion in both the pre- and post-tests. One of the possibilities 
concluded by the main field test was that the selection of discussion topics 
which are conducive to a thoughtful discussion may be one of the things 
teachers learn in a training program on higher cognitive questioning. When 
discussion ma terial was assigned to teachers, they had unusually high baseline 
data for percent of higher cognitive questions. For example, the 7th Grade, 
group began with an average of 67 percent higher cognitive questions and were 
able to increase to only about 73 percent on the post-test after having 
taken Minicourse Nine. Knowing what material the class is discussing is 
helpful to coders in making decisions about categories of questions* We 
would conclude that allowing teachers to choose their own discussion topics 
permits the important variables to operate in studies of this kind and that 
the disadvantages of assigning topics outweigh the advantages. The occurance 
of higher cognitive questions may be more a function of the topic for 
discussion which was chosen than it is of the teacher's skill in using higher 
cognitive questions. Further studies comparing groups who use assigned 
topics as opposed to those who don't should answer this question. 

In the conduct of the present study, there were available four copies 
of the videotape version of Minicourse Nine and seven one-inch tape recorders 
for videotape demonstration, instruction and microteaching feedback. Sixteen 
cassette audiotape recorders, were supplied by the Northwest Regional •Educa- 
tional Laboratory for pre- testing, post- testing and audiotape microteaching 
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feedback for Group B. The immediate supervisors for the interns in the study 
were familiarized with Minicoursc Nine during a pre-study orientation meeting 
extending over a two-day period. They viewed portions of the four tapes used 
with Group A and looked at the videoscripts used with Group B and the teacher's 
manual used in both groups* Careful training in the use of both video 
recorders and audiotape recorders by interns and supervisors resulted in no 
equipment failure during the conduct of the study. One videotape recorder 
was replaced before the study was started so no participant was bothered by any 
equipment malfunction. The pre-test was conducted during one week prior to the 
beginning of the course. The interns were brought together in several groups 
and shown how to organize the classroom using a discussion group of about 12 
students and the placement of the cassette audiotape recorder to get a good 
sound pickup© Those who were going to be using videotape likewise were 
instructed in the operation of the equipment, the use of the counter to gauge 
time, etc. This was done in groups of two to four interns. The course itself 
was conducted as a regular part of the interns' training during Winter Quarter 
of 1971. The course carried college credit. The acceptance of the course by 
teachers was favorable as has been demonstrated many times in previous tests 
by the Far West Laboratory of this and other minicourees. 

The cassette audiotape recordings of pre- and post-test discussions were 
transcribed as typescripts and then coded into the categories K, C, A, S, E 
(Knowledge, Comprehension, Analysis, Synthesis, Evaluation). The three coders 
were not aware of whether typescripts were pre- or post- tests. Coders were 
periodically checked against standardized typescripts to ascertain and 
maintain reliability which ranged from .81 to .89. 
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Frequency and length of student responses were also counted from the 
typescripts. Conventions developed by the Far West Laboratory were used in 
dealing with unintelligible or inaudible remarks. In general tape recordings 
were of good quality and no equipment failures were experienced. 

Coders were trained using typescripts supplied by the Far West Laboratory 
which had coded them in the main field test of Minicourse Nine. Rules for 
making coding decisions were also supplied by the Laboratory. Several 
training and practice sessions were required before coders achieved acceptable 
reliability (.80). 

In summary, it is our conclusion that: (1) Minicourse Nine can be used 
effectively with ongoing programs such as the University of Oregon intern 
program which has participants in situations remote from the campus; 
(2) audiotape can be used for microteaching with effectiveness where verbal 
behaviors are the prime focus; (3) our results substantiate conclusions from 
other studies that suggest the audiotape recorder should be more widely used 
in supervision and teacher education: (4) further studies reed to investigate 
which applications are uniquely suited to the videotape recorder and which 
are just as well handled by the audiotape recorder; and (5) further investi- 
gations should be made into the relationship between teacher questions and 
student responses as a function of discussion topic, categories of teacher 
questions, and categories of student responses* 
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Table 3 



Analysis of Covariance for Knowledge Question Data 



Total 



Within 



Between 



1. Sum of products 726.75 656.063 70.688 

2. Sum of squares: X 12995.2 12947.7 49.531 

3. Sum of squares: Y 10414 10308.9 105.125 

4. Degrees of Freedom 31 30 1 



8. Adjusted y 

9. Degrees of Freedom 
for adjusted sums 
of squares 



10373.4 



30 



10275.6 



29 



97.725 



F = .276 



F .05 * 4 ' 18 



10. Homogeneity of re- 
gression 



F * .348 F Q5 * 4.20 



Table 4 



Analysis of Variance by Covariance Adjustments for Comprehension 

Question Data 



Total Within Between 

1. Sum of products -197.75 -181.125 -16.625 

2. Sum of squares: X 1870.88 1825.75 .45.125 

3. Sum of squares: Y 821.5 815.375 6.125 

4. df 31 30 1 



8. Adjusted y 2 800.598 797.406 3.192 

9. df 30 29 1 



F = 0.116 F Q5 = 4.18 



10. Homogeneity of regression 
F = 2.133 



F .05 = 4 ' 20 



Table 5 



Analysis of Variance by Covariance Adjustments for Analysis 

Question Data 



Total Within Between 

»> 

1. Sum of products 1038.06 1073.13 -35.063 

2. Sum of squares: X 5768.88 5753.75 15.125 

3. Sum of squares: Y 3688.22 3606.94 81.281 

4. df 31 30 1 



8. Adjusted y 

9. df 



3501.43 
30 



3406.79 
29 



94.638 
1 



F = 0.806 



F .05 " 4 ' 18 



10. Homogeneity of regression 



F = 0.166 



F .05 = 4 ' 20 



Table 6 
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Analysis of Variance by Covariance Adjustments for Synthesis 

Question Data 



Total 



Within 



Between 



1 . Sum of products 

2. Sum of squares: X 

3. Sum of squares: Y 

4. df 



419.563 
1745.88 
2861.47 
31 



398. 
1717.75 
2844.94 
30 



21.563 
28.125 
16.531 
1 



8. Adjusted y 

9. df 



2760.64 
30 



2752.72 
29 



7.919 
1 



F = 0.008 



F .05 = 4 ' 18 



10. Homogeneity of regression 
F = 0.138 



F .05 " 4 ' 20 



Table 7 

Analysis of Variance by Covariance Adjustments for Evaluation 



Question Data 

Total Hi thin Between 

1. Sum of products 291.25 271.563 19.688 

2. Sum of squares: X 3304 3297.88 6.125 

3. Sum of squares: Y 3579.72 3516.44 63.281 

4. df 31 30 1 



8. Adjusted y' 3554.04 3494.08 59.969 

9. df 30 29 1 



F = 0.498 F ot: = 4.18 



10. Homogeneity of regression 
F = 3.245 



F .05 = 4 ' 20 



Table 8 



Analysis of Variance by Covariance Adjustments for Higher- 
Cognitive Question Data 







Total 


Within 


Between 


1 • 


Sum of products 


10 


-87.5 


97.5 


2. 


Sum of squares: X 


1302*;. 5 


12975,5 


50. 


3. 


Sum of squares: Y 


11106 


10915.9 


190.125 


4. 


df 


31 


30 


1 


8. 


2 

Adjusted y 


11106. 


10915.3 


190.707 


9. 


df 


30 


29 


1 




F = 0.507 




F .05 * 4 ' 18 





10. Homogeneity of regression 



F * 0.031 



F .05 ' 4 ' 20 



Table 9 



Analysis of Variance by Covariance Adjustments for Higher- 
Cognitive Response Data 



Total Within Between 

1. Sum of products 4218.5 2074.81 2143.69 

2. Sun of squares: X 8050 6723.88 1326.13 

3. Sum of squares: Y 13873.2 10407.8 3465.28 

4. df 31 30 1 



8. Adjusted y 

9. df 



11662.6 
30 



9767.7 
29 



1894.86 
1 



F = 5.626 



F .05 = 4 ' 18 



10. Homogeneity of regression 
F = .72 



F .05 - 4 ' 20 



Table 10 



Analysis of Variance by Covariance Adjustments for Mean Length of 
Higher-Cognitive Student Response Data 



Total Within Between 

1. Sum of products 690 634.313 55.688 

2. Sum of squares: X 1671.72 1637.69 34.031 

3. Sum of squares: Y 2364 2272.88 91.125 

4. df 31 30 1 



8. Adjusted y 2 2079.2 2027.19 52.01 

9. df 30 29 1 



F = .744 F n: = 4.18 



10. Homogeneity of regression 



F = .067 



F .05 = 4 ' 20 
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PART B 



AUDIOTAPE AND VIDEOTAPE FEEDBACK: 
REVIEW OF RELATED LITERATURE 



Introduction 

Video and audio feedback studies are reviewed in chronological order 
within this chapter. The first portable videotape recorder was available 
for field use in 1963, therefore all the literature within the chapter post 
dates this year. The early video recorders were heavy and expensive, but 
as they became lighter, more reliable, and less costly, one finds a correspond- 
ing increase in their use and accompanying research. The same is generally 
true for the audiotape recorder except that it was several decades ahead of 
the videotape recorder in its development. 



Two of the earliest studies on microteachinp were conducted by Acheson 

(1964).* The first compared the relative effectiveness of three types of 

feedback — supervisor, pupil, and videotape self -evaluation. The second 

compared the relative effectiveness of videotape feedback and variou3 forms 

of supervisor feedback using decreasing teacher monologue and increasing 

pupil participation as dependent variables. The findings supported the 

hypothesis that videotape self-evaluation and pupil feedback are superior to 

supervisor feedback in brining about changes in the teaching skills of interns. 

In a later study, Dwight W. Allen (1966) researched the effects of feed- 

2 

back and practice conditions on the acquisition of teaching strategy. His 
findings, although not entirely consistent, tended to favor massed practice- 
immediate feedback over distributed practice-reinstated feedback in learning 
probing techniques in questioning strategies. Retention inferences were also 
drawn from the fact that distributed practice-delayed feedback groups maintained 
higher probing response rates on the post-test than did massed practice- immediate 
feedback. 

In a paper presented at the American Educational Research Association 
annual meeting, W. Dwayne Belt (1967) reported that his research indicated im- 
proved performance on the part of trainees following evaluation and feedback 

3 

in a microteaching setting. Belt's setting consisted of the presentation of 
a lesson by a college student teacher to a class of three to five high school 
students. If high school students were not available, the lesson was presented 
to peers in the college class. The lesson was videotaped and replayed immediately 
for the student teacher with evaluation coming from his college instructor, the 
college peers, and the microclass high school students. The instructor, with 
the trainee, decided upon one or two areas of major difficulty upon which the 
trainee should concentrate in his next presentation within a week's time in a 
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new microteaching setting. Ninety-six percent of the 490 college students 
involved in the training felt they benefited from th<£ feedback in this early 
microteaching research. 

A major early investigation of micro teaching feedback dealt with modeling 
and feedback variables. Directed by E.J. Orme (1966), the study indicated 
increasing effectiveness in the following order when modeling and feedback were 
manipulated: 

Least 1. Minimum symbolic modeling (saw pretest video tape playback alone 

Effective 

studied written instructions, planned, and retaught). 

2. Maximum symbolic modeling (saw playback with experimenter who 
gave cues and reinforcement, studied written instructions, 
planned and retaught). 

3. Minimum perceptual modeling (saw playback and perceptual model 
alone, planned, and retaught). 

4. otroc/t symbolic and maximum perceptual modeling (same as 2* bur 
also viewed perceptual model alone). 

5. Maximum perceptual modeling (viewed playback alone but saw per- 
ceptual model qith experimenter). 

Most 6. Strong symbolic and maximum perceptual modeling (saw playback 

Effective 

and perceptual model with experimenter). 
Using "probing 11 as the dependent variable (scored by two trained raters), two 
interesting c onclusions of the research were that perceptual modeling appeared 
superior to symbolic modeling and that self-feedback effectiveness was well 
beyond expectation, contrary to research done by Orme, McDonald, and Allen earlier. 

In investigating the effects of feedback and modeling procedures of teaching 
performance in a series of experiments, McDonald and Allen (1967) found evidence 
that iudicated feedback (as compared to no feedback) is more effective in a 
training design, yet aot highl y effective in producing behavAoral change*^ They 
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sug£ested that self -feedback might be improved with cueing procedures. 6 Their 
analysis lead to a decision rule: "Always Include a feedback system In which 
the trainee views his own performance with supervision ." 7 (italics added) Yet 
here they found it difficult to separate out the behavior of the experimenter 
(supervisor) and his cue-discrimination characteristics. The investigation 
could not show correlation with the information characteristics of the feedback. 
They did conclude that immediacy of feedback, as measured by time, was not a 

Q 

critical factor. This was of importance both theoretically and practically, 
for it suggested that the feedback process was dependent upon the characteristics 
of the subject's information processing, not the time-space relations. This 
would allow a wide range of feedback systems which would be tmore manageable 
and economic. ^ 

Gllman (1968) explored several feedback* methods £«r correcting errors using 
computer-assisted instruction.^ His variables were: a) no feedback; b) feedback 
of "correct" or 'Wong" responses; c) feedback of the correct responses; d) feed- 
back appropriate to the student's responses; and e) a combination of Modes (b), 
(c) and (d). He concluded: 

1. Feedback guiding a subject to the correct responses was more efficient 
than feedback forcing the subject to "discover 11 the correct responses. 

2. The most efficient feeooack was that which provided b*>th feedback of 
correct responses and feedback as to why the responses were correct. 

Analysis of variance on post-test scores revealed that the combination of modes 
(condition (e) above) was slightly superior (but not statistically significant) 
to comparison to some of the individual modes listed above. 

The effectiveness of feedback to the classroom teacher as a function of 
Its source was studied by Bruce W e Tuckmen and Wllmot F. Oliver (1968). 10 The 
authors divided 286 vocational education teachers (grades ten through thirteen) 
q Into years of teaching experience and subjected fMtm to one of four experimental 
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conditions: 

1. Feedback from students 

2. Feeo -Ik from supervisors (vice-principal) 

3. Feedback from both students and supervisors 
A. No feedback 

Effectiveness, as neasured by change in students 1 ratings over a 12 week interval, 
was greatest when the source of feedback was students only. Supervisor feedback 
did not contribute to the effectiveness when added to student feedback. In 
fact, when given alone it resulted in change in a direction opposite to the 
feedback as compared to the no-feedback condition. Considering years of experience 
in relation to four conditions led to a fascinating conclusion. Student feed- 
back was better received by less experienced teachers while sort experienced 
teachers received supervisor feedback aw re receptively. 

In one of the first attempts to investigate the effects of viewing video 
tapes of one's own teaching behavior , Salomon and McDonald (1968) found that in 
the absence of standards of models, a teacher's satisfaction with his own teaching 
performance was determined ^y initial self -a ttitides . 1 1 Low self -attitudes 
and low attitudes towards teaching performance In the initial interview and 
questionnaire resulted in predominately defensive reactions to self-viewing in 
the post-viewing questionnaire and interview. The study interpreted the finding 
•a suggesting a differential use of self-viewing procedures in teacher education 
using personality variables of the viewer to determine the appropriate method 
of feedback. 

A study dealing with low language aptitude and feeooack in a second semester 
college French class was conducted by Theodore Mueller (196b). ^ Fast research 
in language education had revealed that students with low language aptitude 
often have poor powers of auditory discrimination. Mueller concluded Chat 
q audio and visual (written) feedback was significantly superior to audio feedback 
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alone. 

Feedback via video* tape verses do feedback In a mlcretrachlng setting was 
researchei by Borg, Kallenback, Morris and Frlebel (1968)* 13 The hypothesis, 
"student teachers completing the entire mlnlcourse sequence will display a 
greater number of significant changes in the teaching behavior covered in the 
mlnlcourse than student teachers who complete the mlnlcourse %d thout videotape 
feedback," was supported. Change in behavior was measured by raters scoring 
coded 16 minute pre* and post-course Videotape recordings of each student 
teaching his class, the change being the methods used in conducting class 
discussion. A comparison of audio and video feedback has been done outside 
the micioieachlng setting. Anthony Hulee's study (1968), An Experimenta l 
Study of the Relative Fedogoglcai Effectiveness of Videotape end Audiotape Play - 
back of Student Speech for Self -Analysis in a Basic Speech Course, had as Its 
hypothesis "the greater the completeness and accuracy of student speech per- 
formance feedback, the greater the degree of speech nklll a studeL will later 
14 

exhibit." Three groups were compared. Ufting the completeness of the feedback 
as the manipulated variable, the three levels of feedback were described as: 
1. Videotape replay of two class performances plus traditional (class 

and Instructor) feedback for all performances. 
2» Audiotape replay of tw class performances plus traditional feedback 

for all performances. 
3. Ho electronic replay of any class performances but traditional feedback 
for all performances combined with viewing videotapes of three other 
sneakers. ^ 

The dependent variable, speech skill, was judged using an eleven-point version 
of the Price muiti-tacter speech performance rating scale by judges with an over- 
all reliability of .95 as estimated by the Cbel intra-class procedure. 

The analysis of the data indicated that group iN»e 9 those receiving video 
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feedback on two of their speeches, demonstrated si golf icantly greater overall 
speech skill aod bodily action, personality, language, aad vole* skills thaa 
either of the other two groups. There were no statistically significant dif- 
ferences between the first aod final speeches of the other two groups. 

1q a study conducted by David Young (196&) Stanford secondary Interns were 
randomly assigned to six experimental groups. 16 He made the hypothesla that a 
combination of viewing a specific illustration and a complete model with con- 
tingent focus, and the viewing ot one's own performance with contingent focus 
would be the most effective type of modeling and feedback in s mlnlcourse 
netting* A specific illustration was defined as a videotape of a teacher demon- 
strstlng a specific teaching skill without children and not in the context of 
a lesson. A complete model was defined as a videotape of a specific teaching 
skill in a short, complete lesson to genuine students* Contingent focus was 
defined ss focusing an intern's attention on a specific reaching skill b> a 
supervisor in person or by a pre-recorded commentary while the Intern watched 
the performance on a videotape. The combination of the specific illustration 
and complete model with contingent focus was found to be superior at the .05 
level when compared with the combination without contingent focus. Yet the 
importance of conticgeot focus was mot significant for all variables^ The 
study did not show that the contingent focus of a lesson by a supervisor after 
viewing a lescon us superior to a contingent focus by a supervisor, live or 
recorded, during the salf -viewing of a videotaped lesson by an intern. 

One result is quite clear. The effectiveness of modeling protocols 
varies with the nature of the dependent variable. That is, one 
type of model may be more effective for teaching subjects to use 
one specific teaching skill than another type of model would be. 
It is also suggested that for some skills a symbolic model may 
suffice. B 

Philip Laager (196*), Senior Program Associate of the Far West Laboratory 
for Educational Research and Development* presented a paper as a part of a 

O 
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symposiun on "Microteaching «od Minicourses: iUtlooflcs and Current Research 1 ' 
wo the annual meeting of the American Educational Research Affectation. * 
Within the document he traced the development of microteaching and the mini- 
course. Of interest are his tvo basic reasons accounting for the success of 
the program 

1. The reinforcement (feedback) derived iron seeing oneself on the 
videotape monitor.* 

2. The reinforcement (feedbatk) derived from the emphasis on and per- 
ception of student behavior change in association with increased 
proficiency in a teaching skill. 

Another study (Birch, 1969) f done in a micro teaching setting, attempted 
to discover the effects of: a) a Social Studies curriculum course; b) self- 
confrontation by videotape, c) videotape-coding practice; and d) guided self- 
analysis. In this study the curriculum course, aelf -confrontation, and coding 

22 

practice were all component parts of guirted self -analysis. Guided self- 
analysis consisted of tvo phases. ^ The first phase consisted of: 

1. A videotape was re.orded of the teacher interacting with his pupils. 

2. The teacher viewed the videotape. 

3. The teacher famll<»rized himself with the coding categories. 

4. The teacher analysed kxs own behavior on the videotape using the 
categories (identified specific behaviors and discriminated between 
bt/haviors in different but related categories.) 

5. The teacher they summed the frequencies, computed the proportions, 
and constructed a profile of his teaching behavior. 

6. He then compared the profiles with interpretive figures and characterised 
his own teaching behavior. 

7. The teacher was asked to make inferences about the learning coneequeoces 
q of his observed teaching behavior. 
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8. Finally the teacher formulated operational goals and made a commitment 
to achieving them in his future teaching. 

The second phase: Following this the teacher again taught a lesson which 
was recorded on videotape and the guided self -analysis re-occured. The second 
self -analysis differed from the first in that the student was asked to compare 
the results of this phase to the results of the first phase. This routine then 
became cyclic over a period of time. 

It was concluded that guided self -analysis effected behaviar change on the 
part of the teacher, but that self -confrontation and videotape coding did not. 
The behavioral change was explained by the desire for consonance. That is, 
the guided self -analysis induced dissonance by showing discrepancies between 
the teacher's ideal and his actual behavior. But the operational nature of 
the guided se If -ana lysis furthered consonance. 

In studying the effects ol modeling and feedback treatments on the deveiop- 
nent of teachers' questioning skills, Karen E. Clause (1969) found evidence to 
support the hypothesis that during modeling and feedback, cued (as opposed to 
non-cued) treatments increased the frequency of teacher higher-order questioning 
behavior. She also found evidence to support the hypothesis that cued modeling 
is more effective than cued feedback. The result, the study reports, "lends 
support to the distinction that modeling is an acquisition variable and feed- 
back is a performance variable."^ 

Charles Adair and Aldan Kyle (1969) conducted a study on the effects of 

three types of feedback on the dependent vsrlable, percentage of probing questions 

25 

asked. Three groups ot randomly aelected ei&th-grede teachers were given one 
of the following types of feedback procedures: 

1. Teacher-supervisor conference following the observation of the class 
by the supervisor (standard observation). 
q 2. Self -analysis of their own videotaped teaching. 
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3. Directed self -analysis (assisted by supervlsor)of their own videotaped 
teaching. 

Contrary to some of the earlier studies of feedbsck, Adair and Kyle coo* 
eluded that, 

Analysis of the data la this study indicates that feedback provided 
by videotape produces significant change In toat aspects of question- 
asking behavior In classroom Instruction. The aethods involving 
videotapes appear to reduce the percentages of rhetorical questions 
that teachers asked while no significant differences were observed 
tfith respect to tk% percentage of probing questions. In addition 
to modification In question-asking behavior, other changes were 
observed in clothing sensitivity, alertness, and enthusiasm. 

The evidence that was collected in this study does not favor either 
self -analysis or directed analysis for changing teacher behavior as 
the aethods were defined in this project. The amount and type of 
assistance given to the teachers who use th* directed analysis ap- 
proach night be crucial variables in determining the effectiveness 
of this method. 26 

A recent study on "The Effects of Mode of Feedback In Mlcroteachlng n was 

2 7 

conducted by Shiveiy, Vao Modfratas, and Reed (1970) of Purdue University. 
Their study looked at effects on teacher performance and attitude*. Manip- 
ulations of the conditions under which the supervisor gave feedback were: 

1. The supervisory critique of the mlcroteachlng lesson was based upo f . 
a videotape recording of the lesson. 

2. The supervl&ory critique of the mlcroteachlng lesson was baaed upon 
an audiotape recording of the lesson. 

3. The supervisory critique of the mlcroteachlng lesson was baaed upo i 
the supervisor's watching the live lesson. 

4. The supervisory critique of the mlcroteachlng lesson was based upon 
the responses of the mlcroteacning students to the Stanford Teacher 
Competence Appraisal Guide. The STCAG measured the student's perception 
of tne teacher's aims, planning, performance, and evaluation in the 
teacher's mlcroteachlng lessons. 

Two measurements were meed In the analysis of the data for all groups. The 
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Stanford Teacher Competence Appraisal Guide (STCAG) analyzed Che performance 
of the teacher while an attitude scale measured attitudes towards various 
aspects of micra teaching experience. 
The authors concluded that: 

1. Significant differences existed in the ratings of the performance of 
subjects (teachers) within the four treatment groups on all items of 

the performance measurement. (These items are listed in Table I 

28 

that follows on page 11.) 

2. Performance was most affected by supervisory critiques based on 
audiotapes. 

3. Performance was least affected by supervisory critiques based upon 
watching the actual lesson. 

4. Generally, performance was affected more by supervisory critiques 
based on videotape than the live watching, but less than both the 
audiotapes and student response groups. 

3. The attitude toward the audio-sod videotape groups was significantly 
higher than the live lesson and student response groups. 

6. That "Within the limits of this study the audiotape treatment appears 

29 

to be the strongest treatment.*' 
In explaining the outcomes, of the study the authors suggested that the 
skills focused upon by the measurements were verbal and the lecture method was 
most often used. Therefore the greater amount of critical information was 
verbal. The addition of non-verbal Information added by the video feedback 
was Irrelevant. 

It thus becomes apparent that the less expensive audio method of 
feedback may te substituted for the sort expansive video method 
for inducing positive behavioral changes in teaching performance. 
It may even by possible to dispense with both audio* and video* 
tape and focus attention upon the ratings of the students** 0 
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Variable 



Tibit I 

Student Ratings of MicroteachlcR Teachers* Perf onsaace 

ANCCVA r- Ratio 



Clarity of purpose 



F(3.50) 22.83, pCOOOl 



Difficulty and appropriateness F(3.50) 14.79, poOOOl 
of the alas 



Organltatlon of parts and 
whole of lesson 

Approprl taeness of content 
for alas, class level, and 
teaching nethod 



F(3.50) 24.61, pc.0001 
F(3.30) 24.29, p-.OOOl 



Evidence of relation between F(3.30) 6.00, pcOOl 
materials and content 

Tendency of pupils to cone to F{3.29) U.67, p,<^0001 
attention and direct theaselves 
to the task 

Presentation of content under- F(3.29) 27.29, p<*0001 
standable using different points 
of view 

Movement from topic to topic F(3.28) 12.64, p<.0001 
governed by class tempo 

Attentive class and partlcl- F(3.29) 6.31, pc.Ol 
pates when appropriate 

Attempt to connect chance and F(3.2d) 11.21, p<.000l 
planned events to immediate and 
long range alms 

Teacher-pupil relationships F(3.30) 3. 14, p-^05 
harmonious 

Use of a variety of procedures F(3.29) 15.29, p^.OOOl 
to evaluate progress 

Teacher and pupils review eval- F(3.29) 15.07, p^OOOl 
uatlons for improvement purposes 



Ordered means (P .05 ) 
AT t SR^LL.VT* 
AT, SR^LL, VT 

SR, AT>VT^LL 

SR, AT VT-^LL 

AT, SR f VT^LL 
AT^SRrVT-LL 

AT, SR^VT^LL 

AT, SR, VT^LL 
AT^VT, LL 



AT^VT^LL AND 
SfULL 



N.S.D. between 
Individual means 

AT^SR^VT AND 
AT^LL 

ATpVT, LL, SR 



* AT, SR LL, VT means that groups AT and SR are not different from each other 
but are rated significantly high than groups LL and VT on the variable described. 
Groups LL and VT are also not different from each other. Similar notation will 
be used for all 13 variables. 
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The Use of the Portable Videotape Recorder in helping Teachers Self - 
Evaluate Their Teaching Behavior was the focus of a research study conducted 
by Phillip M. Ward (1970). 31 The stated null hypothesis of this study was 
"there will be no significant difference in criterion instrument scores which 
measure the number of types of questions (basic, leading, probing) which 
teachers ask their students among the following groups of ioservice elementary 
teachers who purposefully self -evaluate their teaching by (1) self videotapes, 
(2) self audiotapes, (3) a combination of self videotapes aod model videotapes, 

and (4) reflective evaluation only (i.e. without mechanical or electronic 

32 

equipment) . n The author concluded that it would be possible to use audio 
tape feedback in the self -evaluative process designed to produce change In 
teaching behavior. J This conclusion was reached since the largest mean dif- 
ference in numbers of probing questions asked by teachers between the pre and 
post tapes was found in the audiotape group. In explaining this Ward writes, 

Apparently the necessity to listen intently without visual con-* 
centration provides stimulation sufficient to significantly affect 
the questioning-skill ability of teachers. It is possible that 
audiotape recorders are grossly underrated and it is suggested 
that, based upon the findings of this study, school districts 
re-evaluate ways in which this device may be used to enhance 
teacher effectiveness. 

This review of literature could not be concluded without recognizing 
the valuable contribution of an educational Resource Information Center (ERIC) 
computer search of relevant literature. The search listed 230 items of which 
otnly the most pertinent were reviewed in this chapter. 
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MINICOURSE - QUESTIONING STRATEGIES STUDY 

This paper reports the results of studies conducted at the Univer- 
sity of Oregon during Winter quarter of 1971, using Minicourse Nine, 
Thought Q uest ions in the Intermediate Grades , developed by the Far West 
Educational Laboratory for Research and Development and Questioning 
Strategies , a program developed by the Northwest Regional Educational 
Laboratory. Both programs were in prototype form, but packaged in a 
format for field testing. The Minicourse included four videotapes for 
demonstration and instruction purposes and a participant's handbook, 
including directions for Micro- teaching, using videotape recorders. The 
categories of questions treated by the Minicourse were derived from 
Bloom's Taxonomy and consisted of Knowledge, Comprehension, Analysis, 
Synthesis and Evaluation. The Questioning Strategies package consisted 
of a participant's manual and provision for groups of three or four 
participants meeting together to work through the exercises cooperatively. 
The categories of questions used in the Questioning Strategies package 
were derived from the work of James Gallagher and consisted of Description, 
Explanation, Evaluation by Matching, Evaluation by Justification, and 
Expansion. 

Minicourse Nine had previously been field tested in the format used 
here, with a control group who did not take th* Minicourse. It had also 
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oeen tested using a format which included written instruction and demon- 
stntion instead of videotapes. Videotape w*s used for the Micro-teach- 
ine practice parts of t he course. In another I'niversitv ~>f Oregon stud* f 
reported elsewhere, Hlnicourse Nine wis used in written form with audio- 
tape Mvcro-teaching. The Questioning Strategies materials had been used 
extensively in workshops wtich incorporated an instructor or workshop 
leader. The present studv in the first testf of the Questioning Strategies 
materials in a completely se 1 f - i ns t rue t iona 1 format. 

The subjects for the study were University of Oregon interns who 
were teaching in grades three throiiKh six in five Oregon c cwmunl t let . 
Thirtv-two subjects were randomly assigned to one of the two groups. 
Croup A (n=16) took Mlnicourse Nine using videotape demonstration and 
instruction with videotape Micro- teaching practice* Croup C (n*l6) took 
Questioning Strategies using the participant's handhook with group dis- 
cussion and other learning activities in groups of three or four. Roth 
groups received college credit for taking the course, and both groups 
completed tne course during Winter quarter of 1971. 

Two pre-tesrs were administered to each group. The first consisted 
of presenting the participants with three pietnr** involving Sailing and 
people on sailboats and asking the participants to write 10 questions 
about the pictures which could be used in an intermediate grade lesson. 
This exercise is a Part of the Questioning Strategies materials an4 had 
been used previously as a pre-test and post-test with the materials. The 
second pre-test consisted of making a 20-minute audiotape recording of a 
classroom discussion in each participant's classroom, using a t >pic chosen 



nv thr p*r lcip*nt. This activity had been used previously In Minicourse 
field t^srs except that in previous Vests the discussion topic had been 
assigned. Both kinds of pre-test were repeated as post-tests upon comple- 
tion of the respective courses. 

The pre- and post- tes t audiotape recordings were transcribed a a 
typescripts and co<5ed by two sets of coders. One set of coders had been 
trained in the Bloom categories, i.e.. Knowledge, Comprehension, Analysis, 
Synthesis, and Evaluation. The other set of coders had been trained in the 
Caii»gher categories. I.e., Description, Explanation, Evaluation by Hatch- 
in*, Evaluation by Justification, and Expansion, Coders were required to 
achieve reliability of .SO before leaving training and beginning actual 
coding. Reliability was checked periodically during the coding process, 
using standardized criterion typescripts. In the case of the Gallagher 
categories, retraining was necessary at one point before resuming the cod- 
ing process. In the case of the Bloom categories, im> retraining was nec- 
essary. In addition to categories of question, coders also counted length 
of response by students to categories of questions and frequency of student 
response. These kinds of data had been used in previous Winicourae field 
testa . 

The numbers of questions In each category were converted to parcents 
to adjust for any differences in total length of time among the audiotape 
recordings. The percent data were then analyzed using analysis of covari* 
ance, using the pre-test as covariate. Tests for homogeneity of regression 
were also applied to assure that analysis of covariance was appropriate. 
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The hvpothese* for the study vere all ft t « t e<i in tenri of null hy- 
potheses , I.e., that therr? would be ncv iigniflcant differences between 
the rvr> groups in t^rms of the criteria which had previously been applied 
to either course. The criteria for the Hinic >urae are quite specific, 
narely, th«t participants will increase their use of higher cognitive 
questions (Comprehension, Analysis, Synthesis, and Evaluation), with at 
le**t two-thirds of the participant* increasing their u*e of higher cog- 
nitive questions by at least 60 percent. If we eliminate the two indi- 
viduals for whom a 60 percent increase was impossible, since they began 
with percents of 86 and 67, then the criterion was achieved for Croup A. 
An equivalent way of testing change in use of higher cognitive questions 
is to look at the u*e of lower cognitive questions (fnowledge). In this 
category Croup A moved f rmn a mean of 63 to a mean of 40, a drop of 37 
percent. Croup C moved from a m#en of 66 to a mean of 56, a drop of only 
15 percent. As shown in Table 5, this difference between the two groups 
is significant at the .05 level of confidence. In terns of individual 
categories of higher cognitive questions. Croup A asked a significantly 
higher percentage of Analysis questions (at the .01 level of confidence), 
as shown in Table 7, and a significantly greater percentage of higher 
cognitive questions (again at the .05 level) as shown in Table 10, as one 
would expect f row the results for lower cognitive questions. • 

The objectives for the Questioning Strategies course are not as 
apeciflc regarding movement among the Gallagher categories or question 
styles (Description, Explanation, Evaluation by Hatching, Evaluation by 
Justification, and Expansion). Participants are expected tis learn to use 



a variety of styles, Hut these itvifs *re not broken Into higher and 
lever cl asstf icstlens , nor Is Any hierarchy intended. An additional 
dii*enslon in the Gallagher model it th* level of abstraction of questions 
(Data, Concept, Genera 1 i ra t ion) „ Analyzing the data f row the transcribed 
?0-i»inute discussions, we find that Group C asked a significantly higher 
percentage of Description questions in the post-test than did Group A 
(«t the .05 level, approaching .01), as svvown by Table 11. Group A 
asked -i significantly greater percentage of Explanation questions (.01 
level) on the post* test than did Group C. Differences between the two 
groups were not significant in the Evaluation by Justification category 
nor in the Expansion category. Evaluation by Hatching was not used by 
either group, hence is not compared statistically. If we lu*»p together 
categories uil»vi than Description, as would be expected, Group A asked 
a significantly greater percentage of such questions in the post-test 
than did Group C (.0$ level, approaching .01). See Tables 12-15. 

For the 10 written questions, there were no significant differences 
between the two groups in the areas of: Knowledge (although both groups 
increased the percentage of such questions), Comprehension (both groups 
increased). Analysis (both decre*£*d, difference approaches .05), Eval- 
uation (both groups Increased), or higher cognitive questions (both 
groups Increased). In the category of questions calling for Synthesis, 
Gr*"jp A increased and Grcvp C decreased the percent of such questions 
between the pre* and post-tests. The difference here was significant at 
the .01 level, as shown in Table 23. The other non-significant differences 
are reported in Tables 20-?5. 



lUing the C*ll*gher categories for the written questions, there 
ver- no «i£nlflcant differences in the changes from pr*- to post-test* 
between the two groups. Both groups decreaned the percentage of Descrip- 
tion questions. Group A increased the use of Explanation questions and 
Croup C o>creaa#*J f ^>ut the difference was not significant. Roth groups 
increased their u*e of Evaluation bv Justification questions. Neither 
group used Evaluation by Hatching. Group C increased their use of 
Expansion questions while Croup A deceased their use, but * differ* 
ence was not significant. The analysis of the foregoing data is pre- 
sented in Tables 26-29. 

Table 31 contains information about the length of student responses 
in both groups in the pre-test* and post-tests. The average of the mean 
lengths of student responses in the Minic :>urse group changed from 10 in 
the pre-test to 13 in the post-test, whereas the Questioning Strategies 
group changed front 11 in the pre-test to 10 in the post- test. The number 
of stuHent responses in th«> Mlnlcourse group dropped from a total of 2718 
in the pre-test to 1736 in the post-test, while the total number of stu- 
dent responses in the Questioning Strategies group dropped from 2S81 in 
the pre-test to 2224 in the post-test. These figures should be viewed 
with some skepticism as there is no assurance of precision. Although 
Interns were asked to make ?0-mlnute recordings of their pre- and post- 
discussion, the length varied somewhat, thus frequency counts are subject 
to variation. The mean length of student response figures are somewhat 
better, since they are expressed in the form of a rate (number of words 
per response) so that time is not an Important factor. On the other hand, 



th + re is also a built-in error, since student responses are not aiwavs 
aulthle, either because they are not loud enough or because wore than one 
student is speaking at one time. Nonetheless, ve can say that there was 
a tendency on the part of the Minicourse group to move toward considerably 
fewer student response! but longer ones, while in the Questioning Strategies 
group there was a less pronounced tendency to move to fewer atudent res- 
ponse*, but they tended to be shorter ones. 

Tables 32 and 33 present another kind of information about the ques- 
tions which were coded in this study. Each question was categorised as to 
level of abstraction. The three levels were Data, Concept, and Generaliza- 
tion, as defined by Gallagher. The numbers of questions at each level were 
then expressed as percents for each intern teacher in the pre- and post- 
tests of classroom discussions. It can be observed that both groups de- 
creased the percent of Data-level questions. Both groups increased the per- 
cent of Concept- level questions, but at the level of Generalization, the 
percent of questions Increased for the Minicourse group and decreased for 
the Questioning Strateglea group. Analysis of covarlance applied to these 
data failed to produce any statistically aigniflcant differences. One may 
say that both courses appear to have influenced the asking of questions at 
higher levels of abstraction. Such a conclusion is tenuous, however, since 
competing explana t iona , such as Increased teacher experience, pupil growth, 
and the like, would be difficult to refute in the present design, which has 
no control group. Control groups have been used in previous tests of Hlnl - 
course Nine . However, those studies did not Include any analysis of the 
level of abstraction of questions. Furthermore, level of abstraction is 
extremely difficult to code with reliability, and we are unwilling to draw 
any sweeping conclusions on the basis of such information. 



1 he category Eva lu* 1 1 on by Hatching was used *o infrequently that 
it was not included in the analysis of this study. A similar phenomenon 
occurred In the field testing of Hlnlcourse Nine with the category Appli- 
cation, which conies from Bloom's Taxonomy . Omitting their pretence in the 
analvsls does not rem that the categories are unimportant, simply that 
If thev «re not used by teachers they cannot be statistically analysed. 
One may ask If such categories as "Application" and "Evaluation (using 
external criteria)" are not being emphasised sufficiently In the ques- 
tioning programs. Further study into the nature of these categories and 
experimentation with ways of presenting them to teachers is suggested. 
Another possibility is that the categories need to be defined In more 
explicit ways in order for trained coders to recognire them when they 
are being used in classroom discourse. 

It seems to us likely that Application questions tend to be coded 
Into the category Comprehension. It seems equally plausible that tea- 
chers are asking Comprehension questions which could Just as well be 
phrased in terms of application to the real world, with Increased moti- 
vational possibilities and more obvious "relevance". Evaluation by 
Matching is an Interesting category of question. 5 1 com* s Taxonomy class!* 
fles It as a sub-category of Evaluation where external criteria are used. 
Gallagher's model treats it as a separate category. It Is possible that 
coders miss Instances of this kind of question when they are not familiar 
with criteria that are customarily used in a given classroom. It is also 
likely that teachers are not giving students enough practice applying 
established criteria to topics of discussion in the classroom. 
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\ u c x t i on of broader import to teacher education In general 
in' off-campus internship* In particular, i* the Successful application 
of *el f- instruct lonal packaged materials which have a measurable effect 
on the classroom behavior of intern teachers* As the result of this and 
other related studies, the University of Oregon Intern Program wl 1 1 con- 
tinue to use packaged sel f - ins t rue t ional materials as a part of its 
regular curriculum. Where cost is a constraining factor, the substitution 
of cassette Audiotape recordings for both instructional purposes and for 
Micro- teaching practice, in lieu of videotape recordings, sppears feasible. 
Further Investigation of the potentials and limitations of this medium 
should be pursued. Constricting the format to include only written 
material appears to produce results that are evident in written exercises, 
but not «o evident in classroom performance. 
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«. nunber of procedures employed in the conduct of the study are 
worth noting. First, although both courses were conducted as self-in- 
structional packages, a considerable amount of coordination was necessary. 
The University of Oregon Intern Program is organized in such a way that 
there are several coordinators who are in continuous contact with interns, 
hence there was someone at all times to call on In case of questions, 
equipment failure, or the like. The coordinators were briefed in a tvo~ 
day retreat preceding the pre-testlng and the beginning of either course. 
They were familiar with the materials and contents of both courses. 

Cassette audiotape recorders were supplied by the Northwest Region- 
al Educational Laboratory for the pre-test and post-test discussion record- 
ings. Materials for th* Questioning Strategies course were supplied by 
the Laboratory and duplicated and bound into package form at the Univer- 
sity of Oregon. Vldeotapea and the participant manuals for Mlnlcourse 
Wine were supplied by the Far Vest Laboratory for Educational Research 
and Development. No equipment failures were experienced during the conduct 
of the study, and time schedules were maintained despite anticipated dif- 
ficulties due to the rather broad geographic area Involved and the amount 
of electronic equipment being used seven videotape recorders and 16 
audiotape recorders. Instruction in the operation of equipment waa pro- 
vided for the interns, and the qoality of recordings, as evidenced by those 
which were turned in for transcription by typists, waa uniformly good. 
Typing, coding, and analysis of the data, using the Bloom categories, was 
completed during Spring quarter of 1971. Coding and analysis, using Gal- 
lagher categories, waa completed during the Sumner quarter of 1971. Addi- 
tional treatment of the data reported In the preaent study may be found in 
Zlgler (1971), unpublished doctoral dissertation, University of Oregon. 



Several conclusions can be drawn from the statistical results of 
the study. Minicourse Wine achieves its specific objective of training 
teachers to ask significantly greater percents of higher cognitive ques- 
tions. In the present study, it also appeared to be getting teachers to 
ask a strikingly greater percent of Analysis questions in comparison with 
the Questioning Strategies group. When analyzed using Gallagher's cate- 
gories, the interns who took Mlnlcourse Nine were asking significantly 
fewer Description questions and significantly more Explanation questions 
in terms of percents on the post-test. Significant differences were 
found between the two groups in the use of Knowledge, or lover cognitive 
questions as opposed to higher cognitive questions, particularly in th& 
area of Analysis. Significant differences were also found in the use of 
questions calling for Description as opposed to questions calling for 
responses other than Description, particularly Explanation. The provi- 
sion of in-class practice and application through Micro- teaching in the 
Minicourse way explain these significant differences in teacher behavior 
evidenced in the classroom taperecord&ngs and transcribed typescripts. 

As hypothesized, significant differences did not occur between the 
two groups in the analysis of written questions using Gallagher categories 
as taught by the Questioning Strategies package, or in the categories 
derived from Bloom with one exception* The Mlnicourse Nine group showed 
a significant gain over the Questioning Strategies group in the use of 
Synthesis questions. A possible explanation for this difference lies in 
the effects or impact of videotaped instruction combined with graphic 
demonstration via videotape as opposed to reading and discussion only. 
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Interpreting tfte results, as opposed to drawing conclusions, permits 
some speculation. The format of the two packages appears to us to have 
had an important effect on the participants. The videotaped portions of 
Minicourse Nine included professional-sounding narration and polished 
editing of soundtrack and picture. The written materials had been devel- 
oped expressly for the self -instructional format. Materials for the 
Q uestioning Strategies package had been developed for use with an instruc- 
tional leader, and were being tested in an auto-instructional format for 
the first time. The materials were in written form only, and employed no 
other media with the exception of group discussions. 

Another difference in the nature of the two courses is in terms of 
structure and objectives. Minicourse Nin e is quite highly structured, and 
the objectives are specific and explicit. The Questioning Strategi es 
course follows an inductive approach to the process of questioning and 
is based on the assumption that the understandings and skills that are 
discovered by the participant will allow for greater personal meaning. 
About half of the material deals with the level of abstraction (data, 
concept or generalization) of questions. The other half deals with the 
styles of questions (Description, Explanation, Evaluation by Matching, 
Evaluation by Justification, and Expansion) used in the present study. 
Minicourse Nine also includes material which is not measured in the data 
or analysis, e.g. , probing questions by the teacher. 



I 



w 
I 



w 



w 



pa 
oo 



u 

c « 
M H 



00 



CO 



CO 



en 



00 



00 



00 



H VO 



00 



00 



00 



co 



00 



00 



00 



m 



m 



On 



ro 00 



CM 



oo 



in 



i -4- 



oo 



i co 
i co 



en 



en 



CM 



oo 



CM 



co 



CO 



CO 



00 
CM 



CM 

CO 



CO 
vO 

m 



m 
co 



m 



O 

CM 



CO 



CO 



CM 



CO 



00 



sO 



CM 



W ^ 

ro m ^ oo 



co 



sO 



CM 



00 

CO 



O 

m 



m 



vO 



m 



CM 



c 

U 
Li 



CM 



00 



3 

O 

H 



m 



o 



3 



9 

ERLC 



W P-4 

» eg 
a 



O Put 

3° 



1 319VI 



0> 
> 

•H 
«J 

•H 

c c 

•*4 CM 

o 

«J CO 

C * u 
4) « 0> 

u -c 
u u cx 

CI C T-« 

w 
w 

1 

us 
i 

a 

o 

s 

r-4 

I » 


« 


r-4 
NO 


oo 


NO 

m 

r-4 
r-4 


o 
o 

CS 

op 


60 ; 100 


NO 

m 
m 


NO 

cn 

cn 
tn 


r-4 

m 

CO 

m 


ON 

o 
m 


CM 

r-4 

o 

in 


1 

cn 

p-4 

CM 

ON 


1 

00 

m 


m 
O 

On 

m 


m 
cn 

o> 

CO 


CO 

cn 
r> ^ 


c 

vT> 

cn 

vO 
ON 


c 

vC 


CM 

NO 




cn 

CM 


O 
O 
r> 

CM 


CO 
CO 
1 


NO 

m 


m 
cn 
i 


o 


o 

cn 


CO 

i 


r-4 

cn 
i 

cn 


^4 

cn 

CM 


1 

cn 
cn 


CM 
p-4 
1 


p^ 

NO 
p-4 

cn 


m 

CM 

Q 
tn 


44 : 2100 


00 

r> 
m 


o 

NO 

CO 

cn 

On 
O 
r*^ 


3 






m 


ON 

in 


On 

m 


CM 


m 


m 


CM 


in 


cn 

CO 


est 


CO 

m 


<f 
cn 


en 


cn 


i/ * 

CM 


ON 

r-4 


m 

> mi 


NO 

r-4 


CM 
r-4 


00 

r-4 


M« 

cn 


tn 


ON 

CM 


— - 

m 
cn 


O 
cn 










CM 
CM 




o 

CO 


cn 

CM 


cn 

NO 


m 
m 


<!■ 

CM 


m 

CM 


ON 


cn 


cn 

-a- 


CM 

cn 


cn 


cn 


o^ 

CO 


cn 
m 








<* 


NO 

CM 


o 

CM 


r-4 


00 

CM 


m 

r-4 


o 


CO 


nO 


NO 


ON 


O 

cn 


tn 

CM 




cn 


CM 
CM 










cn 
i— t 






<n 


m 
< 


CO 

CM 


o 

CM 


~4 
p-4 


CO 

i-4 


ON 


p-4 


1-4 


CM 


p-4 


On 

cn 


o 

cn 








cn 


ON 


cn 


<*"> 
r-4 


CM 


CO 


r-4 
r-4 




1 
1 


1 
1 


NO 


NO 

CM 


ON 


r— ( 

CM 


o> 

CM 


CM 


CM 




o 








1 
1 


NO 

CM 


o 


o 

CM 


1 
1 


1 

1 


CM 

i-4 


tn 


CM 

p-4 


CO 
CM 


NO 
p-4 


I 
I 


CM 
CM 


•-4 


cn 

CO 


p-4 
p-4 




»— < 

CM 


m 


m 


cn 


1 


NO 
r— 1 


m 


o 

CM 


cn 

r-4 


cn 
cn 




cn 
r-4 


ON 




NO 


o 

CM 


ON 
p-l 


CM 
t~ • 


o 
o 






CM 


i 

1 


1 
1 


m 


i—) 


o 

CM 


CM 

cn 


CO 


i 
i 


m 


1 
J 


CM 

cn 


ON 


^ 


ON 


o 

NO 

p-4 


o 

p-4 




p-4 


CM 
CM 


CO 

r-4 


CM 


cn 


CO 
CN 


NO 

CM 


O 
CM 


ON 
i-4 


r-4 


CM 
CM 


m 
m 


r*» 

r»4 


CO 
CM 


ON 

<J 


o 

CM 


CM 


NO 

CM 


vO 
1-4 




m 


CM 


sr 


CM 
CM 


m 


NO 
I— < 


<r 
m 


<f 


NO 


r-4 


m 


cn 

<-4 


CO 


CM 


CM 
p-4 


NO 

CM 


CM 

CM 


vf 
p-4 




00 


ON 


NO 


m 


cn 


CO 


r-4 

i-4 




NO 


1 


NO 


cn 




cn 


NO 




m 

ON 


NO 


o 
<r 
t 




tN 


m 




On 


tn 




i 

i 


00 


o 

«—* 


CM 


CM 
p-4 


cn 


NO 
p-4 


p-4 

CM 




ON 


NO 

cn 

p-4 


ON 




no 

c 
6 

ess 

CO 

< 

u 


cm 


to 

lO 


P-4 

^ 


ON 

tn 


CM 

CM 


o 






cn 

NO 


o 
in 


o 

tn 


cn 


in 


r-4 

<f 


F-4 

r— ( 


CM 


vn 
m 

NO 


o 
<f 


cn 
i 






cn 


m 

ON 


cn 
<t 


NO 


o> 


r— ( 


NO 

tn 


cn 

NO 


ON 


NO 


NO 

m 


CM 


O 

m 


sO 

m 


cn 


p-4 
ON 

CO 


NO 

m 




cn 


lO 


r-4 


in 


r-4 


CM 


CM 


p-4 


i 
I 


i 
i 


p-4 


00 


m 


NO 


o 

r— ( 


CO 


tJD 

c 

0) 

u 


c 


c 
♦l-l 

CO 

cc 

c 
<u 
u 
u 

0) 




cn 


cn 


1 

1 


NO 


vD 




1 
1 


i 
i 


NO 


CM 


tn 


On 


NO 


i 

t 


o 

CM 


nO 


M 


c 

« 

X 




m 


cn 


r-4 


p-4 


1 




r-4 


cn 


CM 




cn 


<t 


m 


CM 




vD 


f i 




1 
t 


1 
1 


cn 


NO 




CO 




1 
t 


CM 


1 
t 


CM 
»-4 


cn 


<t 


m 


c 

o 
u 




cn 

p— l 


vO 


CO 


CM 
p-4 




m 


cn 


cn 


CM 




«-4 


ON 


CO 


r— ( 


NO 


0) 
D 

O 

CO 
O 

H 




m 


cn 


m 


cn 


ON 


cn 


r-4 


cn 


NO 


CM 




cn 




—i 


f-4 


o 

IM 

o 


CM 


m 


CM 


CM 


r-4 


CM 


CM 


-4 


«-4 


I 
I 


r-4 


r-4 




r-4 


CM 


CM 


NO 


CM 


i— t 


CM 


cn 


CM 


1 
1 


CM 


m 


-4 


m 


p-4 


NO 






m 


p-4 

3 

o 

H 




O 

p-4 


CM 

cn 


<f 
i— 1 


m 

CM 


CO 


O 
r-4 


ON 




o 

p-4 


NO 


ON 


r-4 


•— • 

cn 


CM 

r-4 




00 


ON 


O 

cn 


NO 


o 


00 


CM 




i-4 


r-4 

cn 


cn 


ON 

CM 


CO 

p-4 


o 

1-4 


p-4 


o 

tn 


cn 

CM 


Intern 
Teacher 
• Number 




CM 


Cn 


i 


m 


NO 








w 

p-4 


p-4 


CM 
r-4 


cn 
p-4 


p-4 


in 


NU 




cn 
cn 


>j 
<n 


m 
cn 


NO 

cn 


cn 


oo 
cn 


ON 

cn 


o 


9-4 


CM 


cn 




m 


NO 




oo 




W P4 

OS Q m 

Mm 3 

z aiavi 



c c; u 

%l is & 

u m e 

c i> 5 

h h Ss 



X O 



00 



00 



00 



o <n 



00 



00 



oo 



o o 



C rg 



m go 



8 



vo —> 



o o 



© o 

<N O 



1 



iir 



^ N 00 



ERLC 



go 

52 



oc 



s 
31 















C 
<4 


1 




IN 




r 

r- 

OC 


IN 

e* 


o- 


IN 


*~ 


«x 






-> 




IS 


S 




© 


© 

IN 


IN 




© 




IN 




•* 


✓ 














• 

i 

* 

c 
o 

1 * 














1 




IN 


a 


in 


OC 


r> 


•r 

IN 




















o 


© 

OC 




«£> 


•r 
•r 


IN 








IT 
IN 






•r 


oc 


•r 




1 

f 


*\ 




o 




r> 


o 














— 




'<£ 


OC 










»r 


00 


*r 


is* 


■n 
•-^ 






© 




© 


c 








IN 




1 

1 




OC 

c 


O 


o 


C 




IN 




IN 










IN 


r> 


C 






© 






e 


n 


O 








IN 


© 




© 




P 






n 


oo 


** < 

I 

^- I 


D 




o 


c 


C 


c 


n 


€-5 




C 


C 


© 


© 


C 


r~ 


© 










o 


© 




C 


© 


C 


© 


C 


© 


c 


© 


© 


O 


© 


c 


© 


© i 






OC 


















•*> 














© 










oa 


o 


— | 
IN 


OC 






© 


•N 


r-* 


IN 


*— • 






n 




9, 

IN , 


— 






IN 




tN 


*^ 


© 

IN 




© 

IN 


>c 




IN 
IN 










IN 


or; 
#*— 






© 


© 




© 






IN 


© 






© 




oc 




© 




i 


r 

c 




5 B 

c 

f K 

© 

IN 

a 

u 

c tv i- 
c m 5 

M H £ 


OC 




ac 
w~ 


OC 

w* 


m 


o 

NO 


OC 

>© 


C* 




r> 


>o 








IN 




© 
IN 

ac 


fn 








© 
oc 




© 


S 




<r 

IN 


8 


vO 


* 




oc 


«* 












cm 




O 


o 


IN 




IN 






Cm 




















o 




o 


IN 




»N 




© 


•N 


t" 

O 


© 


**• 


J*s 






•si 

i 






O 


O 


O 


o 


o 


© 


o 


© 


C 


O 


© 


© 


© 


© 


^« 


O 








© 


© 


© 


© 


o 


o 


© 


© 


O 


© 


c 


© 


© 


© 


© 








* 


OC 


>£> 


00 


IN 




















00 


oe 
















© 














IN 












1 




! 

i 


ir* 




























*> 










© 






© 


IN 


o 


© 


© 


IN 


r> 


© 


IN 


t 












in 


*■* 


IN 
IN 


i* 








IN 




IN 
»^ 




#n 






m 










IN 
#^ 




IN 


IT 


c 




IN 




in 
r> 




•IN 




IN 




1 

♦ 






in 










1 

1 


ac 


I 


o 




IN 


r* 




*r 










i 




r* 1 


*r 






oc 

1* 




© 




i^ 




1 


1 


1 




DO 
* 






i 
i 



ERIC 



* aitvi 



at 

Si 



TABLE 5 



Croup A and C (20-Mtnute Dtacuaalon Lesaon) 
Anelyala of Covarlanee for Knowledge Queatlon Data 



WITHIN 



1. 
2. 
3. 
4. 



Sun of products 
Su;j of squares: X 
Cura of square*-: Y 
D(.^rtes of Frctdom 



5. Ai^usted 

6. Decrees of Freedom 
for adjusted turns 
ot squares 



7370.94 
10638.7 
170*4.9 

31 



11526.2 



30 



206*. 56 
10581.2 
10314.4 

30 



9909.98 



29 



302.375 
52.531 
1740.5 

1 



1616.26 



F - 4.729 



.05 



4.18 



7. Homogeneity of re« 
gressi on 



0.015 



.05 



4.20 



TABLE 6 



Croup A and C (20-Minute Di»cu«ion Lesson) 
Analysis of Covarlanc* for Comprehension Question Data 



1' 



Surr. of procucts 
5 ux of s qu a re s : X 
Sut, of squares: Y 
Dv ;rcci of F reckon 



Adjusted y* 

;re<?s of Freocoin 
fur adjusted sur.s 
ci squares 



62.4375 

997.469 

31 



993.084 



226.5 
IUJ.75 
944.938 

3C 



899.287 



29 



146.063 
406.125 
52.531 

1 



93.797 



¥ - 3.025 



F .05 " 4.18 



7. K~...c;,cncity of re- 
gression 



? - 5.24791 



F .05 " *- 20 



TABLE 7 



Croup A and C (20-Mlnute Discussion Lesson) 
Aoslyls of Covarlance for Analysis Question Data 



1. f>u:.i of product 4 

2. Su- of squares: X 

3. Sum of squarc-s: Y 

4. Dc ;rcct of /rccoo.T. 



470.594 
3611. 7? 
5397.97 



677.938 
3573.44 
4323.44 

30 



-202.344 
38.281 
1069.53 

1 



5. Adjusted f 4 - 

c. D w ;rees of Frcccicw 
for adjusted sur.s 
ot squares 



5331 .65 



20 



4196.71 



29 



1134.94 



7.84 



.05 



4.18 f. 01 - 7. 



7. K^nogenei ty of re- 
gression 



F - 0.192 



.05 



4.20 



TABU 8 
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Croup A and C (20-Mlnute Discussion Lesson) 
Analysis of Covarlance for Synthesis Question Dsta 



3. 
4. 



Son of products 

of squares: 7. 
Su.r. of squares: Y 
'rces of Kreedor. 



28.0 
1 544 . 0 
3098.97 

31 



:ithin 

28.0 
1544.0 
3048.94 

30 



E"T T-EN 
0.0 
0.0 
30.0 
1 



5. Adjusted y z 

6. D^rees of Fr-i'econi 
fur adjusted surr.s 
of squares 



3098.46 



30 



3068.43 



29 



30.031 



F - 0.284 



.05 



4.18 



7. lic:.;o^enei ty of re- 
gression 



0.235 



F .05 " «- 20 



TABLE 9 



Croup A and C (20-Minute Discussion Lesson) 
Analysis of Covarlance for Evaluation Queatlon Data 



1. Sun of products 

2. S.a of squares: X 

3. Sun of squares: Y 

4. Decrees of Frcedor 



991.031 
3319.47 
3432.47 

31 



VI THIN" 
1051.25 
3250.44 • 
3379.94 

30 



EE' 



•60.21 
69.03 
52.53 

1 



5. Adjusted y z 

6. D.. .^rees of Frecdon 
for adjusted surr.s 
of squares 



3136.6 



30 



3039.94 



29 



96.65 



0.922 



.05 



4.18 



7. H~rr.03er.ci ty of re- 
gression 



0.478 



F .05 - *' 20 



TABLE 10 

Groups A and C (20-Minute Discussion Lesson) 

Analysis of Covariance for Higher Cognitive Question Data 
(Comprehension, Analysis, Synthesis, Evaluation) 







TO--,". 


wn:?is 




1. 


Sum of products 


1760.75 


1546.44 


214.313 


2. 


Sj-.n of squares: 'A 


10763.0 


10770.2 


22.781 


3. 


Sun of squares: Y 


13030 


11013.9 


2016.11 


4 . 


Dc;;rw-cs of Freedom 


si 


30 


1 


5. 


Adjusted y 


12742.8 


10791.8 


1950.92 


6. 


Lv.'.r^cj of Freedom 
lor adjusted sur.s 










of squares 


30 


29 


1 




F - 5.242 




F.o5 * 4.18 





7. Homogeneity of re- 
gression 

F - 0.326 F c5 - 4.20 



TABLE U 



Groups A snd C (20-Minute Discussion Lesson) 
Analysis of Covsrisnce for Description Question Dsts 



"IT" r 



»ithi: 



1. Cum of products 

2. Sun-, of squares: a 

3. Sun of squares: Y 
A. Threes of Freedom 



1185.5 
10034.2 
11200.0 

31 



1243.25 
10032.7 
9022.0 

30 



-57.75 
1.53125 
2178.0 
1 



5. Adjusted y z 

6. degrees of Freedom 
for adjusted sums 
of squares 



11059.9 



30 



8867.94 



29 



2192.0 



F - 7.168 F #05 -4.18 P >01 - 7.64 



7. Homogeneity of re 
gression 



F - 0.217 F 05 " U ' 2 ° 



TABLE 12 



Groups A and C (20-Mlnute Discussion Lesson) 
Analysis of Covar lance for Explanation Question Data 



WITHIN 



beti:.:zn 



1. Son of products 

2. S~- of squares: X 

3. Su... of squares: Y 

4. C-rtrccs of KreeJcCT. 



-325.25 
1942.88 
3457.5 

31 



14.75 
1798.38 
2657.5 

30 



-340.0 
144.5 
800.0 

1 



t. Adjusted y 

6. l^ j;rccs of Freec'on 
for adjusted suns 
o» squares 



3403.05 



2657.38 



29 



745.672 



8.138 



.05 



4.18 



F .oi - 7 ' W 



7. Ho...c^er.elty of re 
^rcss ion 



F - 0.599 



F .05 ^' 20 



TABLE 13 



Groups A and C (20-Minute Discussion Lesson) 
Analysis of Covariance for Evaluation Justification Question Data 



1. Sum of products 

2. Sura of squares: X 

3. Sura of squares: Y 

4. Decrees of Freedora 



TOTAL 
1820.5 
5498.47 
4442.0 

31 



WITHIN' 
1721.13 
5410.69 
4329.5 

30 



BETWEEN 
99.375 
87.781 
112.5 
1 



5. Aujusted y 

6. D^jjrecs of Freedom 
for adjusted sums 
of squares 



3839.25 



30 



3782.01 



29 



57.232 



F - 0.439 



.05 



= 4. 18 



7. iw.-.oger.eity of re- 
gression 



F = 0.016 



F .05 = 4 ' 20 



! 



TABLE 14 



Groups A and C (20-Minute Discussion Lesson) 
Analysis of Covariance for Expansion Question Data 



WITHIN 



BETWEEN 



1. S^r.i of products 

2. Su:v. of squares: X 

3. Su.r. of squares: Y 

4. D^rces of Freedom 



197.375 
1886.97 
1857.5 

31 



191.125 
1886.19 
1807.5 

30 



6.25 
0.781 
50 
1 



5. Adjusted y 

6. Dujroes of Freedom 
for adjusted sums 
of squares 



1836.85 



30 



1788.13 



29 



48.7212 



F = 0.790 



.05 



= 4.18 



7;. Hcmoseneity of re- 
gression 



F = 0.653 F 05 " 4.20 



TABLE 15 



Groups A and C (20-Mtnute Discussion Lesson) 

Analysis of Covariance for Questions Other Than Description 
(Explanation, Evaluation Justification, Expansion) 



Sum of products 
Sum of squares: X 
Sun of squares: Y 
Degrees of Freedom 



TOTAL 

1201.66 
10034.2 

11244.0 

31 



WITHIN 
1259.63 
10032.7 
9049.44 

30 



EETW2EN 

-57.969 
1.531 
2194.53 
1 



Adjusted y^ 

Circes of Freedom 
tor adjusted sums 
oi squares 



11100.1 



30 



8891.29 



29 



2208.77 



F = 7.204 



.05=4.18 F.oi " 7 



.64 



7. Homogeneity of re- 
gression 



F = 0.220 



F .05 =*'20 
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BEST CO ft AVAILABLE 



Groups A and C (Written Question!) 
Analyst* of Covarlsnce for Knowledge Question Data 



: of produces 

. o; squa res : X 
. of squares: Y 
r.es of Freedom 



7832.19 
14821.9 
8222.22 

31 



UITHIN 
7815.0 
14818.8 
8127.69 

30 



17.188 
3.125 
94.531 

1 



/.^justed y i 

'. . • :jos of Freedom 
f r adjusted suns 
c» squares 



4083.53 



30 



4006.27 



29 



77.256 



0.559 



.05 



4.18 



7. i.v,...c,;ci".eity of re- 
gression 



2.028 



F .05 " 4 ' 20 



TABLE 21 



Groups A and C (Written Questions) 
Analysis of Covarlsnce for Comprehension Question Data 



73?,.'. 



WITHIN 



1. of products 

1. Sj.t. of squares: X 

3. Sum of squares: Y 

4. L -xvcs of Freedom 



1475.0 1400.0 

31W. 0 3100.0 

4787.5 4675.0 

31 30 



75.0 
50.0 
112.5 

1 



Aijuatcd y 

L^-;;recs of Freedom 
for adjusted sutr.s 
of squares 



4096.83 



30 



4042.74 



29 



54.083 



F - 0.388 



.05 



4.18 



7. kv ...w^enelty of re- 
gression 



0.069 



F .05- *' 20 



TABLE 22 



Groups A end C (Written Questions) 
Analysis of Cava r lance for Analysis Question Dsta 



1. Si..- oi products 

2. S-..". of squares: X 

3 . S~ of squa res : Y 
i . i..;.-ccs of Freedom 



4203.13 
9121.88 
5871.88 

31 



riTHiy 

3512.5 

8593.75 

4968.75 

30 



bet. :t.?m 



690.625 

528.125 

903.125 
1 



5. Adjusted y z 

6, I . .rcos of Freedom 
for adjusted suns 
o- squares 



3935.18 



30 



3533.1 



29 



402.088 



3.300 



F >05 « 4.18 



7. };>.. .o^or.eity of re- 
gression 



F - 0.018 



F .05 - *' 20 



TABLE 23 



Groups A and C (Written Question*) 
Analysis of Covarlance for Synthesis Question Data 



to: 



l. S^-.r. of products 

I. L-..: o£ squares: X 

3„ l--:r. of squares: Y 

«». Circes of Freedom 



2550.63 
8121.88 
6638.88 

31 



VI THIS 
2486.25 
8118.75 
5312.75 

30 



64.375 
3.125 
1326.13 

1 



5. Acjustcd y 

6. L. .jrccs of Freedom 
fc-r adjusted sums 
cJ squares 



5837.87 



30 



4551.37 



29 



1286.5 



8.197 



F .05 -4.18 P >01 - 7.64 



7. K^...o^cneity of re- 
£ res si on 



0.578 



P .05 



TABLE 24 



Groups A and C (Written Questions) 
Analysis of Covarlance for Evaluation Question Data 



S. of products 
S-.-r. of squares: X 
S •«..:. or squares: Y 
L^.rees of Freedom 



753.125 
6001.5 
6132.22 

31 



368.125 
5201.5 
5946.94 

30 



bet.:::e: 



385.0 
800.0 
185.281 

1 



A;: Justed y^ 

1>. ..ires of Freedom 
i.r adjusted sun-.s 
or icuares 



6037.71 



30 



5920.88 



29 



116.825 



F - 0.572 



F .05 * *«18 



V. homogeneity of re- 
gression 



F - 0.786 



.05 



4.20 



TABLE 25 



Groups A and C (Written Questions) 

Analysis of Covarlance for Higher Cognitive Question Data 
(Comprehension, Analysis, Synthesis, Evaluation) 



i~.r> of products 
Su.;. of squares: X 
£~r:. of squares: Y 
Cjrcos of Freedom 



Adjusted y' 

L^jroes of Freedom 
i^r adjusted sums 
o2 squares 



8016.25 
17980.9 
1 OA 60. 5 

31 



6886.69 



30 



7903.75 
17727.8 
10410.5 

30 



6886.69 



29 



112.5 
253.125 
50.0 
1 



0.0004 



F - 0.021 



F.05 -4.18 



7. hc.;-.ogenei ty of re- 
gression 



F - 1.030 



F .05 - 4 ' 20 



TABLE 26 



Groups A and C (Written Questions) 
Analysis of Covariance for Description Question Data 



BETvrr£N 



s>i.;t. of products 

2. Su.n of squares: X 

3. S-... of squares: Y 
A. Z ;r^os of Freedom 



3069.06 3055.63 

16946.9 16943.8 
9318.22 9260.44 
31 30 



13.438 
3.125 

57.781 

1 



5. Ac^uiited y 

6. ^-.jrtcs of Freedom 
lor adjusted sums 
o2 squares 



8762.41 



8709.39 



29 



53.027 



0.177 



F .05 = 4.18 



7. Homogeneity of re- 
gression 



0.156 



.05 



4.20 



TABLE 27 



Groups A and C (Written Questions) 
Analysis of Covariance for Explanation Question Data 



WI7HIK 



S...:. o2 products 

of squares: X 
S~..i of squares: Y 
L^^rccs of Freedom 



951.875 118.75 

4487.5 4375,0 

4796.47 4548.94 

31 30 



•166.875 
112.5 
247.531 

1 



/.<.., u& ted y z 

w c ,rees of Freedom 
.or adjusted surr.s 
o2 squares 



4394.56 



4262.86 



29 



331.703 



F « 2.257 



.05 



= 4.18 



i;o:.io^eneity of re- 
gression 



3.990 F 05 - 4.20 



TABLE 28 



0 

ERIC 



Groups A and C (Written Questions) 
Analysis of Covariance for Evaluation Justification Question Data 



1. SuJ of products 

2. Sun; of squares: X 

3. Su.r. of squares: Y 

4. Decrees of Freedom 



1718.13 

5387.5 

6045.72 

3i 



WITHIN 
1718.13 
5387.5 
5751.69 

30 



BETv-ZEN 1 

0.0 
0.0 
294.031 
I 



5. Adjusted y 

6. Decrees of Freed ova 
f^r adjusted suns 
of squares 



5497.79 



30 



5203.76 



29 



294.031 



1.639 



.05 



4.18 



7. Ko;r.ocenelty of re- 
g, session 



F = 0.749 



.05 



4.20 



TABLE 29 



Groups A and C (Written Questions) 
Analysis of Covariance for Expansion Question Data 



WITHIN 



BETWEEN 



Sura of products 
Sun of squares : X 
Sum of squares: '.' 
£_;:,rcos of Freedom 



2703.75 
10021.9 
3975.5 

31 



2666.25 
9943.75 
3957.5 

30 



37.5 
78.125 
18.0 
1 



Acju-ted y 

L^r^es of Freedom 
for adjusted sums 
of squares 



3246.07 



3242.59 



29 



3.479 



F - 0.311 



F.05 = 4<I8 



7. r.^:.-.ogeneiuy of re- 
tires sion 



F = 0.984 



F .05 " *< 20 



90 



TABLE 30 



Groups A and C (Written Questions) 

Analysis of Covariance for Questions Other Than Description 
(Explanation, Evaluation Justification, Expansion) 







'.JITHIN 




£-.r. of products 


3069.06 


3055.63 


13.438 


2. of squares: X 


15746.9 


15743.8 


3.125 


3. of squares: Y 


9318.22 


9260.44 


57.781 


i . L^rees of Freedom 


31 


30 


i 


2 

3. Acjujted y 


8720.06 


8667.39 


52.672 


o. r v.- ~* roc ^ of Freedom 
for adjusted sums 
of squares 


30 


29 


i 


F - 0.176 




F. 05 - 4.18 




7. r.cr.-.o^enelty of re- 
gression 

F = 0.086 




F .05- *' 20 
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